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701 



SET OF OPERATOR TREES (set_of_operator_trees) WITH RESOURCE 
VECTORS AND KNOWN PARTITIONING RECEIVED. 



702 



COMMENCE COMPILE TIME ADJUSTMENT FOR EACH OPERATOR TREE 
(operatorjree) WITHIN SET OF OPERATOR TREES. 



703 



CALL COMPILE_TIME_ADJUSTMENT FUNCTION WITH OPERATOR TREE 
AND AVAILABLE THREADS (operatorjree, availablejhreads). 




NO 



YES 



705 



COMMENCE SCHEDULE GENERATION FOR EACH OPERATOR TREE 
(operatorjree) WITHIN SET OF OPERATOR TREES 
(set of operator trees). 



706 



CREATE COMPONENT EXPANSION; NORMALIZE NPS RESOURCES. 



707 



IDENTIFY PIPELINES. 



TO 
FIG. 7B 
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CONSTRUCT PIPELINE DEPENDENCY TREE (EVENT TREE). 








709 


DISTRIBUTE RESOURCE VECTOR FOR ANY EXCHANGE (Xchg) 
OPERATOR; SET INITIAL MINIMUM COST VALUE (Min_cost - +infinity). 















710 



FIND ALL UNSCHEDULED PIPELINES. 




SCHEDULE SET OF PIPELINES BY CALLING PIPELINE SCHEDULING 
FUNCTION (pipeline_sched(a set of pipelines)). 




EVALUATE SCHEDULE FOR CURRENT OPERATOR TREE 
if elapsed_time(operator_tree) < Min_cost 

{ Min_cost = elapsed_time(operator_tree); 
best_operator_tree = operator_tree; }. 




RETURN BEST OPERATOR TREE (best_operator_tree). 



DONE 
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INVOKE Compile_time_adjustment FUNCTION WITH AN OPERATOR TREE 
(operator_tree) AND AVAILABLE THREADS (availablejhreads) AS INPUT. 




PERFORM POST-ORDER TRAVERSAL OF OPERATOR TREE TO CREATE 
ANCHOR TREE. EACH TIME EXCHANGE NODE HIT IN TRAVERSAL OF 
TREE, PACKAGE INTO ANCHOR TREE NODE (ANCHOR NODE) AND PUT 

INTO ANCHOR TREE. 
EACH ANCHOR TREE NODE HAS THE FOLLOWING INFORMATION: (1) 
WHETHER EXCHANGE NODE IS ADJUSTABLE; AND (2) INITIALIZATION 
OF ADJUSTED THREAD COUNT = ORIGINAL THREAD COUNT. 




903 



TRAVERSE ANCHOR TREE AND INSERT EACH ANCHOR NODE INTO A 
PRIORITY QUEUE SORTED BY COST (LEAST COST ANCHOR TREE AT 
HEAD OF PRIORITY QUEUE). CALCULATE TOTAL THREADS USED. 



YES 




REMOVE ANCHOR NODE AT HEAD OF PRIORITY QUEUE. 



TO 
FIG. 9B 




POP 
ANCHOR 
NODE 

FROM 
PRIORITY 
QUEUE. 
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907 



DECREMENT ADJUSTED THREAD COUNT BY 1. 
DECREMENT TOTAL THREADS USED COUNT BY 1. 
ADJUST COST OF SUBTREE AT THAT ANCHOR (EXCHANGE) NODE. 
PUSH ANCHOR NODE IN PRIORITY QUEUE. 



908 



PERFORM TRAVERSAL OF ANCHOR TREE. FOR EACH ADJUSTED 
EXCHANGE NODE, REDO PARTITIONING TO REFLECT ADJUSTED 

THREAD COUNT. 






RETURN ADJUSTED OPERATOR TREE. 
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1201 



INVOKE ParPipeLineSchedule FUNCTION WITH DESCRIPTION OF GLOBAL 
NPS RESOURCES AND AN OPERATOR TREE TO BE SCHEDULED. 



IDENTIFY PIPELINES AND CREATE EVENT TREE. 



1202 



1203 



RESTORE PS COST VECTOR; OBTAIN ACTUAL COST VECTORS FOR 
OPERATORS; NORMALIZE NPS RESOURCE USAGE. 



1204 



CREATE OPERATOR CLONES BASED ON PARTITIONING DEGREE OF 

OPERATOR. 



1205 



CREATE MACRO-CLONES WHICH ARE CLONES THAT NEED TO BE 
SCHEDULED FOR SAME SITE; PACK A CLONE BY ITSELF INTO MACRO- 
CLONE STUCTURE. 



IS MAX NPS 
RESOURCE USAGE OF PIPELINE 
GREATER THAN MAX NPS RESOURCE 
WAILABLE AT SITE?, 

YES 



1206 



NO 



1207 



SPLIT PIPELINE TO N PIPELINES WHERE (TOTAL NPS RESOURCE 
USAGE DIVIDED BY N) IS LESS THAN RESOURCE AVAILABLE AT SITE. 
ADD N-1 STORE OPERATORS THAT MATERIALIZE PIPELINE INTO N 
PIPELINES AT APPROXIMATE INTERVALS SUCH THAT EACH OF THE 
FRAGMENTS ARE EQUALLY DISTRIBUTED IN TERMS OF NPS 
RESOURCE USAGE. MARK MACRO-CLONES TO IDENTIFY NEW 
PIPELINES. DELETE OLD PIPELINE AND ADD NEW PIPELINES TO SET. 



TO 
FIG. 12B 

FIG. 12A 
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1208 



CALL ParDriveScheduleToShelves FUNCTION WITH THE EVENT TREE 
AND GLOBAL RESOURCE DESCRIPTION AS INPUT. 
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DONE 



FIG. 12B 
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ParDriveScheduleToShelves Function INVOKED WITH EVENT TREE 
AND GLOBAL RESOURCE DESCRIPTION AS INPUTS. 



1302 



IDENTIFY ALL UNSCHEDULED PIPELINES THAT ARE 
INDEPENDENT AND CAN BE SCHEDULED; SAVE SET OF 
IDENTIFIED PIPELINES IN A LIST LP. 




FIG. 13A 
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SORT PIPELINES IN INPUT SET OF PIPELINES LP BASED ON 
ELAPSED TIME DETERMINED FROM CRITICAL PATH. 






ADD MACRO-CLONES TO NPS BINS FOR SITES WHERE THEY 
NEED TO BE SCHEDULED. MARK MACRO-CLONES ALREADY 
PINNED TO A GIVEN SITE BECAUSE OF DATA AFFINITY. 



1311 



1312 
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1313 



PARTITION A LIST OF PIPELINES {P1 , P2,...Pn} INTO L LISTS (LI = 
{P1,...Pi1}, L2 = {Pi1 + 1,...Pi2}, LL = {Pi(k-1) + 1,...PN}) SUCH THAT 
THE LENGTH OF THE SET Lj IS <= P*(1 - ORG), WHERE P IS THE 
NUMBER OF SITES AND Lj IS MAXIMAL. 



1314 



1315 



1316 



COLLECT MACRO-CLONES NOT ATTACHED TO A SITE FOR THE 
NEXT MEMBER OF LIST L. 



CALL PipeBinPack FUNCTION (LIST OF PIPELINES 
CORRESPONDING TO NEXT MEMBER OF LIST L). 



MARK SHELF NUMBER ON PIPELINES USING MACRO-CLONES; 
INCREMENT SHELF NUMBER; MARK PIPELINES IN THIS 

PARTITION AS SCHEDULED. 






REPEAT STEPS 1314-1316 FOR EACH OF THE L LISTS. 
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DONE 
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1400 



1401 



PipeBinPack FUNCTION INVOKED WITH INPUT SET OF MACRO- 
CLONES AND SET OF BINS WITH KNOWN NFS RESOURCES. 




' 


SORT MACRO-CLONES ACCORDING TO SUM OF PS DIMENSIONS 
OF MACRO-CLONE DIVIDED BY TOTAL NPS RESOURCE USED BY 

MACRO-CLONE. 






PIN ALL MACRO-CLONES WITHIN SET OF MACRO-CLONES TO 
SITES THAT THEY NEED TO BE PINNED TO. 




' ^ 


ADD THE NEXT UN-PINNED MACRO-CLONE TO BIN X WHERE 
NPS FOR BIN X + NPS FOR MACRO-CLONE IS THE LEAST. 






REPEAT STEP 1404 FOR EAC 
WITHIN THE SET 0 


H UN-PINNED MACRO-CLONE 
F MACRO-CLONES. 
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1403 



1404 



1405 



c 



DONE 
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